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© Hierarchical memory system. 



© A hierarchical memory system in which a lower level 
(40) transfers data serially to an upper level (12) and in 
parallel to a yet lower level. The lower level includes a 
two-port memory chip (25) having a wide buffer (28) for 
parallel accesses to the memory array, to the yet lower level, 
and to a serial buffer (32). The serial buffer is serially 
accessed by the upper level simultaneously with accesses to 
the wide buffer. 
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This invention relates to a hierarchical memory system 
in accordance with the preamble of claim i. 

Almost all computer systems include some type of 
memory. Th predominant type of memory used for com- 
puter application is random access memory (RAM) although 
larger systems requiring vast amounts of memory storage 
typically include additional serial memory, usually in the 
form of magnetic tapes or discs. In simpler computer sys- 
tems, the one or more memories are directly connected to 
the processor which then directly reads into and writes from 
a selected memory device. 

However, there is a trend toward hierarchical memories 
in which a larger, higher level memory is not connected 
directly to the processor but instead transmits to and re- 
ceives data from a lower level memory. The lower level 
memory receives data from and transmits data to, not only 
the higher level memory, but also the computer. A cache 
memory is one exam pie of a lower level memory. The 
concept of multi-level memories may be extended to more 
than two levels of memory. 

An example of a hierarchical memory is illustrated in 
Figure 1, in which two memory cards 10 and 12 contain 
respectively a low level memory and a high level memory. 
Each card 10 or 12 contains an array of memory chips 14 
and 16. Typically, the memory chips of the low level mem- 
ory 10 are faster but of fewer number than the memory 
chips 15 of the high level memory 12. Thus the high level 
memory 12 is used for bulk storage while the low level 
memory 10 is used for its fast access and buffering capabil- 
ity. The low level memory 10 provides data from its mem- 
ory chips 14 to the computer systems through a primary 
port 18 and a fast data channel 20. Similarly, the low level 
memory provides data to the high level memory 12 through 
a secondary port 21 which is connected to an I/O port 22 of 
the high level memory 12. The secondary port 21 and the 
I/O port 22 are connected by an inter-level channel 24. 
Data transmission on the two channels 20 and 24 can be 
done in either direction. In typical designs, the low level 
memory 10 can operate only one of its ports 18 and 21 at 
any one time. That is, the low level memory 10 either 
selects the primary port 18 for access by the data channel 
20 to the computer system or alternatively selects the 
secondary port 21 for access by the inter-level channel 24 
and the high level memory 12. The data channel 20 usually 
is a high speed channel, matched to the computer system, 
and is a parallel bus. In contrast the inter-level channel 24 
has a different channel capacity. The low level memory 10 
provides buffering between the differing data rates on the 
two channels 20 and 24. 

A disadvantage of the memory system of Figure 1 is 
the lack of simultaneous access of the two ports 18 and 21 
to the memory chips 14. While data is being accessed 
through the secondary port 21, either in a read or a write 
mode the memory chips 14 cannot be accessed by the 
data channel, thus impacting the operation of the fast paced 
computer system. Another disadvantage is that during the 
serial accesses through the secondary port 21, the memory 
chips 14 and their support circuitry need to be fully powered 
at a power level dictated by the inherent cycle time of the 
chip. As a result, the memory system of Figure 1 is both 
stow and demands full power for each access. 

The use of dual ported memory chips in a hierarchical 
memory system is disclosed in US-patent 4.489.381 and 
EP-A-851 07253.8. 



Accordingly it is the object of the present invention to 
provide a hierarchical memory system of the aforemen- 
tioned kind that allows simultaneous multiple access to a 
tower level memory. 

5 This object is achieved by the invention of claim 1; 

embodiments of the invention are characterized in the de- 
pendent claims. 

The invention proposes a hierarchical memory system 
in which a lower level memory is built from two-port mem- 

10 ory chips. Data is accessed randomly from the memory chip 
to a primary buffer. Data can be transferred between the 
primary buffer and a secondary buffer within the memory 
chip. The primary buffer and the secondary buffer can be 
independently and simultaneously accessed from outside 

75 the chip at differing data rates. A parallel access to the 
primary buffer is used for accesses to the computer system 
or a yet lower memory level. Accesses to the secondary 
buffer are performed serially and are made available to a 
higher level memory. The memory chip does not require full 

20 power for each access. 

An embodiment of the invention is now described in 
detail with reference to the accompanying drawings, .in 
which: 

25 Figure 1 is a block diagram of a hierarchical memory 
system in the prior art; 

Figure 2 is a schematic diagram of a two-port memory chip 
usable with the present invention; and 

30 

Figure 3 is a block diagram of one embodiment of the 
hierarchical memory of the present invention. 

35 The present invention uses a two-port memory chip in 

its hierarchical memory. Several varieties of mufti-port chips 
have recently been developed. For instance, Nordling at al. 
in U.S. Patent 4,410,964 discloses a memory device with 
two ports, each with multiple bits. Rao in U.S. Patent 

40 4,347,587 discloses a memory chip with both parallel and 
serial parts. However, in this chip, the serial port is asso- 
ciated orrfy with a portion of the memory dedicated to the 
serial port Ackland et al. in U.S. Patent 4,412,313 dis- 
closes a two-port chip in which a shift register is connected 

45 to the parallel output lines and can provide a high speed 
serial output Baltzer in U.S. Patent 4,150,364 discloses a 
somewhat different memory system in which two rnemory 
chips can be simultaneously accessed. 

A two-port memory chip 25 particularly useful for the 

50 present invention is illustrated in Figure 2. This type of chip 
is described by R. Matick et al. in a technical article entitled 
"All Point Addressable Raster Display Memory" appearing 
in the IBM Journal of Research and Development Vol. 28, 
No. 4, July 1984 at pp. 379-392. Data is stored in a 

55 memory array 26 in long words of 128 bits. Each 128-bit 
word can be randomly accessed by a row address. The 
individual words are accessed through sense amplifiers and 
latches 28 which thus serve as a buffer to the rnemory 
array 26, The 128-bit word in the latches 28 is further 

60 subdivided into smaller bytes, typically of from 2 to 4 bits 
apiece. Each byte in the latches 28 is randomly accessed 
by a column address for a transfer to or from the 4-bit wide 
primary port Data in 128-bit words can also be transferred 
in parallel between the latches 28 and a master register 30. 

65 In order to decouple the transfer word from the latches 28, 
the master register 30 can be accessed by a slave register 
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32 by the parallel transfer of the 128-bit word. Selection 
circuits control the slave register 32 so that it can be 
accessed serially through a secondary port AH the pre- 
viously described transfers can occur in either direction. 

In the two-port memory chip 25, the slave register 32 
can be accessed through the secondary port independently 
of the access of the latches 28 through the primary port 
For instance, a word can be read from the array 26 into the 
latches 28 and then" transferred through the master register 
30 to the slave register 32. Thereafter, this word can be 
read serially from the slave register 32 out through the 
secondary port Simultaneously with the serial access 
through the secondary port, the latches 28 can be acces- 
sed by the primary port Additional words can be read from 
the array 26 into the latches 28 and then outputted through 
the primary port, all during the reading of the single word in 
the slave register 32 out of the secondary port Further- 
more, multiple words can be read into the array 26 from the 
primary port while the secondary port is operating in the 
write direction. For a fairly high speed chip, the parallel 
access through the primary port may be operating at a 
cycle rate of 80-150 ns per word while the serial access 
through the secondary port is not likely to exceed a cycle 
rate of 20 ns per bit For 128-bit words, the secondary port 
is thus cycling at 1.56 ms per word, thus permitting many 
accesses of data through the primary port in the same time 
that one complete word is accessed through the secondary 
port 

One embodiment of the present invention uses the 
two-port memory chip 25 in a hierarchical memory system 
illustrated in Figure 3. Similar elements to those of Figure 2 
are numbered with the same reference numerals and will 
not be further discussed. The two- port memory chip 25 is 
included in a lower level memory card 40. The master 
register 30 and the address and selection lines are not 
explicitly shown in Figure 3. The primary port of the mem- 
ory chip 25 is connected through a first I/O port 42 to the 
data channel 20 to the computer system. This I/O port 42 
could be up to 4-brts wide in present technology for the 
described memory chip 24. The secondary port of the 
memory chip 24 is connected through a second I/O port 44 
to the inter-level channel 24 to the high level memory 12. 

It is seen that the computer system can simultaneously 
access the latch 28 while the high level memory 12 is 
accessing the slave register 32. Thus the slave register 32 
can be accessed relatively slowly over the serial inter-level 
channel 24 for one word while several words can be 
accessed between the array 26 and the computer system 
through the latch 28. The accesses can be any combination 
of reading and writing. Of course, when the access to the 
stave register 32 has been completed, a subsequent access 
to the slave register 32 would require either a read from or 
a write to the array 26. This subsequent access necessarily 
involves the latch 28 so that the the accessing through the 
primary port to the computer system is necessarily inter- 
rupted. However, the duration of this interruption of the. 
primary port is only a small fraction of the total access time 
through the secondary port The simultaneous operation of 
the primary and the secondary ports eliminates significant 
waiting time caused by data transfers between levels and 
can lead to significant improvements in overall performance 
of the hierarchical memory system. 

Compared to the hierarchical memory system of Figure 
1. the present invention offers several advantages. The 
improved performance by a simultaneous access to the two 
ports provides improved performance. During those periods 
when only the secondary port is being accessed and no 
data is being transferred between the slave register 32 and 
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the array 26, the 1/0 port 42 associated with the primary 
port and the sense amplifiers and latches 28 can be de- 
powered. This depowering reduces both the average and 
the peak power levels required for the lower level memory 

5 card 40. This reduced power results in a tower operating 
temperature than for the conventional approach. The reduc- 
tion in temperature is expected to be about 10°C. Because 
of the depowering, the tower level memory 40 is expected 
to have improved reliability, predicted to be about a 20% 

io reduction in cumulative failures. The use of serial memory 
in the memory chip 16 of the higher level memory 12 
provides a cost reduction because a serial access memory 
can be made at lower cost than RAM. 

Although the lower level memory 40 of Figure 3 has 

75 been described as consisting of a single memory chip 25, 
the invention can be applied to a lower level memory 40 of 
multiple memory chips, each having two ports connected 
respectively to the I/O parts 42 and 44. The different 
memory chips can either be separately selected depending 

20 upon the address or can be operating in parallel to provide 
different bits of an addressed word. 

it should be noted that the memory organization for the 
lower level memory 40 of Figure 3 is not appropriate if the 
slave register 32 is not on the same memory chip as the 

25 memory array 26. Such an off-chip slave register would 
require an inordinate number of 1/0 pins from the latch 40 to 
the off-chip slave register. Furthermore the simultaneous 
transfer of so many bits of data across the chip boundary 
would create a power surge if it were performed between 

30 different chips. 

The described embodiment assumes a control transfer 
of data between the latch 28 and the slave register 32. 
However, in some applications where the flow of data is 
predictable, any access of array 26 through the primary port 

35 could be designated to cause an automatic transfer of data 
with the slave register 32 for a corresponding access 
through the secondary port 

Claims 

40 

1. A hierarchical memory system using dual-port memory 
chips (25) in at toast one hierarchy level characterized in 
that there are provided: 



- first buffer memories (28) in the dual-port chip being 
connected to the array (26) and the first port of the chip; 

so - second buffer memories (32) in the dual-port chip being 
connected to the first buffer memory (28) and the second 
port of the chip; 

- means (42) for randomly accessing the first buffer mem- 
55 ory (28) from the next lower hierarchy level; 

- means (44) for serially transferring information between 
the second buffer memory (32) and the next higher hierar- 
chy level. 



2. Memory system in accordance with claim 1, character- 
ized in that 

65 a complete memory row is transferred in each access 
between the first buffer m mory and the memory array. 

3. Memory system in accordance with claim 1 or 2, char- 
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acterized in that 



characterized in that 



the information exchange between the first and second 
buffer memories is effected in complete memory rows. 

4. Memory system in accordance with one of the claims 1 
to 3, 



means are provided to depower the first buffer m mory (28) 
if only accesses to the second buffer memory are effected. 

6. Memory system in accordance of one of the claims 1 to 
5, 



characterized in that 

a third buffer memory (30) is interconnected between the 
first buffer memory (28) and the second buffer memory (32) 
on the dual-port memory chip. 

5. Memory system in accordance of one of the claims 1 to 
4, 



w 



15 



characterized in that 

means are provided to transfer the contents of the first 
buffer memory to the second buffer memory upon each 
access of the memory array. * 
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© A hierarchical memory system in which a lower 
level (40) transfers data serially to an upper level 
(12) and in parallel to a yet lower level. The lower 
level includes a two-port memory chip (25) having a 
wide buffer (28) for parallel accesses to the memory 
array, to the yet lower level, and to a serial buffer 
(32). The serial buffer is serially accessed by the 
upper level simultaneously with accesses to the wide 
buffer. 
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